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ABSTRACT 

Traditionally,  power  system  scheduling  and  control 
are  separately  implemented.  To  bridge  the  gap  between 
these  two  activities,  online  adjustment  of  the  optimal 
schedule  is  necessary.  Because  such  adjustment  degrades 
energy  efficiency  and  dynamic  response,  it  is  desirable  to 
integrate  the  two  functions  seamlessly.  One  possible 
solution  is  to  optimize  the  control  references  directly.  In 
this  paper,  a  fully-distributed,  multi-agent  based  control 
solution  is  presented  to  reduce  the  fuel  consumption  of 
shipboard  power  systems.  Every  generator  has  an 
associated  agent  that  only  communicates  with  its 
neighboring  agents.  With  a  properly-designed 
communication  network,  the  solution  can  guarantee 
convergence,  even  during  losses  of  the  communication 
channel.  This  fully-distributed  design  can  significantly 
improve  the  reliability  and  survivability  of  the  system, 
especially  during  battle  conditions.  The  improved  sub¬ 
gradient  based  optimization  solution  can  address  both 
equality  and  inequality  constraints  and  can  provide 
performance  comparable  to  that  of  centralized  solutions. 
Simulation  studies  demonstrate  the  effectiveness  of  the 
proposed  solution. 

INTRODUCTION 

Optimal  generation  scheduling  is  a  much-studied 
problem  in  power  system  research.  It  aims  at  allocating  the 
power  generation  to  meet  the  power  demand  in  an 
economic  or  profitable  way,  while  continuously  respecting 
the  physical  constraints  of  the  power  system  [1-3].  The 
optimal  generation  schedule  cannot  be  mapped  to  the 
control  reference  automatically,  so  online  adjustment  is 
necessary.  Considering  that  the  adjustment  is  not  optimal, 
both  energy  efficiency  and  dynamic  performance  will 
degrade.  To  improve  performance,  it  is  desirable  to  bridge 
the  gap  between  power  system  operation  and  control 
seamlessly.  One  possible  solution  is  to  optimize  the 
control  reference  for  generation  directly,  though  doing  so 
places  demanding  requirements  on  the  speed  of  the 
supporting  algorithm. 

Most  existing  generation  scheduling  solutions  are 
centralized  [4-5].  As  centralized  solutions  require  the 


communication  and  processing  of  large  amounts  of  global 
data,  they  experience  difficulty  providing  a  fast  response. 
The  delays  inherent  in  centralized  decision-making  render 
it  unsuitable  for  online  optimization  [6],  especially  when 
considering  the  small  inertia  of  a  shipboard  power  system 
(SPS)  and  the  severe  changes  in  operating  conditions.  In 
addition,  centralized  solutions  are  inflexible  and 
susceptible  to  single-point  failures  [7-8].  Improving  the 
efficiency  and  survivability  of  high-performance  naval 
SPSs  requires  more  reliable  alternatives.  Because 
distributed  solutions  can  overcome  the  previously- 
mentioned  disadvantages  of  centralized  solutions,  they 
have  attracted  much  attention  in  recent  years. 

To  address  the  needs  of  SPSs,  a  fully-distributed,  multi¬ 
agent  system  (MAS)-based  solution  is  proposed  to 
optimize  the  control  references  of  distributed  generators 
online.  As  one  of  the  most  popular  distributed  control 
solutions,  MAS  can  provide  good  reliability  and  efficiency 
if  properly  designed.  In  the  past  years,  MAS  has  been 
applied  widely  to  various  SPS  problems  [9-12].  Even 
though  MAS  has  tended  to  be  oversold,  its  potential  has 
not  been  fully  explored.  Recent  advancements  in 
consensus  and  cooperative  control  make  advanced  MAS- 
based  design  possible. 

The  proposed  solution  is  fully  distributed  in  the  sense 
that  each  distributed  generator  has  an  associate  agent  that 
communicates  with  its  neighboring  agents  only.  No 
centralized  or  specialized  agent  is  used  to  coordinate  the 
operation  of  the  autonomous  agents.  The  topology  of  the 
communication  network  for  the  agents,  which  is 
independent  of  the  topology  of  the  power  network,  is 
designed  based  on  the  N- 1  rule.  According  to  the  design, 
any  two  agents  are  always  connected  directly  under  the 
loss  of  one  communication  channel.  Thus,  the  proposed 
solution  is  less  susceptible  to  single -point  failures. 

Based  on  the  designed  communication  network,  the 
autonomous  agents  can  realize  an  improved  distributed 
sub-gradient  algorithm.  This  algorithm  is  used  to  optimize 
the  control  references  directly.  Unlike  existing  distributed 
sub-gradient  algorithms,  the  improved  algorithm  can 
address  both  equality  and  inequality  constraints.  The 
equality  constraints  are  satisfied  by  adjusting  local 
generations  based  on  a  properly-de signed  updating  rule. 
The  inequality  constraints  are  addressed  by  constructing  a 
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virtual  communication  network  during  constraint 
violations.  The  distributed  algorithm  is  suitable  for  online 
optimization  and  can  provide  performance  comparable  to 
that  of  centralized  solutions.  Simulation  studies 
demonstrate  the  effectiveness  of  the  proposed  solution. 

This  paper  is  organized  as  follows.  Section  II  formulates 
the  SPS  generation  optimization  problem.  Section  III 
introduces  the  distributed  sub-gradient  based  optimization 
algorithm.  Section  IV  addresses  the  implementation  of  the 
MAS-based  solution.  Section  V  presents  some  simulation 
results,  and  Section  VI  summarizes  the  conclusion. 

PROBLEM  FORMUALTION 

The  optimal  generation  scheduling  problem  can  be 
formulated  as  follows: 


min  Y.PpiPi) 

(a) 

A" 

II 

(b) 

(1) 

s.t.  Pi<Pi<Pi 

(c) 

where  n  is  the  number  of  generators  in  a  shipboard  power 
system,  Pt  is  the  power  output  of  the  i,h  turbine  generator, 
rj(P.)  is  the  unit  power  fuel  consumption  of  the  generator, 

Pd  is  the  total  power  demand,  and  p  and  p.  are  the  lower 

and  upper  bounds  of  the  zth  generator’s  output,  respectively. 
rj(P)  is  typically  an  exponential  function  with  respect 

to  power  output  (P,)  and  can  be  expressed  as  (2)  [1]: 

?(/>)  =  ^  +  (2) 

1-e 

Even  though  the  fuel  consumption,  p.-r/(P.),  is  not  a 

strictly  convex  function,  it  can  be  approximated  by  a 
convex  function.  The  polynomial  fitting  technique 
introduced  in  [13]  can  be  utilized  to  approximate  (2)  as  a 
convex  function.  Usually,  a  second-order  polynomial  is 
sufficient,  as  shown  in  (3): 

Pi-r/(Pi)~fi(Pi)  =  a2I>2+alPi+a0  (3) 
Thus,  (1)  can  be  rewritten  as  (4): 


min  £/;(/>) 

(a) 

ii 

(b) 

(4) 

s.t.  Pt  <Pt<P, 

(c) 

In  (4),  is  a  convex  function  with  respect  to  Ph 

DISTRIBUTED  SUB-GRADIENT 

ALGORITHM 

In  the  following  derivation,  p  =  [PVP2,P3,.-.  denotes 

n 

the  vector  of  the  outputs  of  the  generators,  y’(p)  =  V/jfP) 


denotes  the  objective  function,  and 
V/(P)  =  C'iv-i^^v-^-"  denotes  the  sub-gradient  of 

the  fuel  consumption  functions,  with  denoting  the 

derivative  of  f](P)  with  respect  to  P,. 

If  the  inequality  constraints  are  ignored,  the  convex 
optimization  problem  (4)  will  have  a  unique  optimal 
solution  -  P  .  As  given  in  [14],  the  optimal  conditions  are: 

irp’=^,  v/(p*)=n  (5) 

where  1  is  a  column  vector  of  ones  and  A*  is  the  unique 
optimal  Lagrange  multiplier. 

The  challenge  with  the  distributed  optimization 
algorithm  is  how  to  find  P  in  a  distributed  way. 
According  to  the  distributed  sub-gradient  algorithm,  the 
local  updating  rule  can  be  represented  in  a  scalar  format, 
as  in  (6): 


pl(k+i)=pl(k)-wll'IK.„  (o 

where  Wti  and  Wy  are  elements  of  the  weight  matrix  W, 
and  Nj  represents  the  indices  of  agents  that  communicate 
with  agent  i. 

The  overall  system’s  updating  process  can  be 
represented  as: 

P(*  +  1)  =  P(*)-WV/(P(*))  (?) 

The  algorithm  is  distributed  because  local  generation  is 
adjusted  based  on  local  information  only.  (7)  is  listed  here 
to  help  clarify  the  overall  system’s  activities. 

According  to  [14],  the  selection  of  W  must  yield  the 
following  two  properties  [14].  First,  P(V)  should  always  be 
feasible,  i.e.  lrP (k)  =  Pd  for  all  k.  Second,  P  should  be  a 


fixed  point  of  (7),  i.e.,  P*  =  P*  -  WV/(P*)  =  P* 


Accordingly,  W  must  satisfy  the  following  two  properties: 

lrW  =  Or 
W1  =  0 


(8) 


where  0  is  a  column  vector  of  zeros. 

If  W  is  a  symmetrical  matrix  and  satisfies  one  of  the 
above  two  conditions,  then  it  will  satisfy  the  other 
condition  automatically.  In  this  paper,  W  is  adjusted 
dynamically  based  on  the  topology  of  the  communication 
network.  According  to  the  improved  Metropolis  method 
[15-16],  elements  of  W,  i.e.,  Wg,  are  calculated  according 
to  (9): 


-2  /  \ni  ( k )  +  rij  (A)] 


W„(k)=> 


-S  W 

jeNj 


10 


j  e  idxi(k),  j  ^  i,  ni  ^  0 

j  =  i 


(9) 


otherwise 


where  n^k)  and  n/k)  are  the  numbers  of  elements  in  Nt  and 
Nj,  respectively,  and  idxt{k )  is  the  set  of  indices  of  the 
neighboring  buses  of  bus  i. 

Note  that  the  above  method  only  considers  the  equality 
constraint  of  (4.b).  Because  the  inequality  constraint  is 
neglected,  the  resulting  solution  might  be  impractical.  To 
avoid  violations  of  inequality  constraints,  the  above  sub¬ 
gradient  algorithm  is  modified  as  follows: 


i  g  idxh(k ) 


(10) 


m 


m+D=\ 


Pt  (k)  -  a(k)^  Wy  (k)j  j  v- 


;  idx,{k)c 


l  J= 1 

where  iA(A;+l)  is  the  immediate  update  of  iA(&),  cc(A)  is  the 
step  size,  y,  is  the  derivative  of  the  local  cost  function, 
idxb(k)  is  the  set  of  indices  of  the  generators  whose 
generations  lie  on  the  boundary,  and  idxbikf  is  the 
complement  of  idxh(k). 

If  the  calculated  generation  of  a  generator  lies  within  the 
boundary,  the  actual  generation  will  be  updated  as  usual.  If 
the  calculated  value  falls  beyond  the  pre-set  bound,  the 
generation  of  the  corresponding  generator  will  be  held 
fixed  and  excluded  from  future  updating.  Because  other 
agents  still  need  to  update,  the  boundary  agent(s)  will  work 
as  a  hub  of  communication  for  its  neighboring  agents.  If 
two  neighboring  agents  are  connected  indirectly  through 
the  boundary  agent,  that  boundary  agent  will  form  a  virtual 
direct  communication  channel.  If  two  neighboring  agents 
also  are  connected  directly,  the  boundary  agent  does 
nothing  for  them.  These  operations  can  be  formulated 
using  graph  theory. 

If  the  communication  network  is  represented  as  an 
undirected  graph,  this  graph’s  connectivity  can  be 
described  using  an  adjacency  matrix  whose  elements  ay 
are  calculated  according  to: 


,,  .  (1  if  i  and /  are  connected 

a«(k)  =  \o  otherwise 


(11) 


Thus,  n(k )  in  (9)  can  be  calculated  according  to  (12): 


ni(k)  =  Yjaij{k)  (12) 

7=0 

During  optimization,  afk)  is  updated  dynamically 
according  to  (13).  The  updated  ay(k)  will  change  the 
weight  matrix  W  indirectly. 


aJk  +  l) 


0 

aM&aqWlciyik) 
au  (k) 


i  g  idxfk )  or  j  g  idxb{k ) 
b  g  idxfk )  and  i,j  g  idxfk ) 
otherwise 


(13) 

If  properly  designed,  the  solutions  obtained  by  a 
distributed  algorithm  will  be  comparable  to  those  obtained 
by  a  corresponding  centralized  algorithm. 


DISTRIBUTED  CONTROL  SYSTEM 
ARCHITECTURE 

The  distributed  control  system  is  illustrated  in  Fig.  1. 
Each  generator  in  an  SPS  is  equipped  with  an  agent  that 
communicates  with  other  generator(s)  according  to  the 
topology  of  the  designed  communication  network.  The 
agents  will  optimize  the  outermost  control  loop  references 
of  the  generators  for  active  power  control. 


Fig.  1  Control  system  architecture 

The  design  of  the  communication  network  is 
independent  of  that  of  the  physical  power  network.  The 
design  of  the  communication  network  and  the  control  of 
the  turbine  generator  are  introduced  in  the  following 
section. 

Communication  Network  Design 

If  the  communication  network  is  represented  as  a  graph, 
the  communication  channels  correspond  to  the  edges  of  the 
graph.  Thus,  the  edge  connectivity  of  the  graph  will 
determine  the  reliability  of  the  system.  The  higher  the 
connectivity,  the  more  reliable  the  network  [17-18].  In  this 
paper,  the  AM  rule  is  utilized  to  design  the  topology  of  the 
communication  network. 

The  AM  rule  dictates  that  any  two  nodes  are  still 
connected  directly  when  any  one  of  the  edges  is  disabled. 
In  this  case,  the  original  graph  must  contain  at  least  one 
loop  that  connects  all  of  the  nodes  in  the  graph.  For  the 
system  illustrated  in  Fig.  2,  loop  /3  can  encircle  all  of  the  4 
nodes.  Thus,  the  network  satisfies  the  AM  rule.  It  can  be 
verified  easily  that  disconnecting  any  edge  will  not  isolate 
any  of  the  nodes. 


Fig.  2  Simple  communication  network  (graph) 

In  general,  the  communication  network  satisfies  the  N- 
1  rule  if  and  only  if  the  complete  loop  matrix  (CLM)  (C  for 
short)  of  the  graph  corresponding  to  the  communication 
network  satisfies  the  following  condition: 

maxY  C.  =  n  0^) 

i=\...  '  J 

J=L 

where  «/  and  ne  are  the  total  number  of  loops  and  edges  of 
the  graph,  respectively,  and  n  is  the  total  number  of  nodes. 
Now,  consider  the  CLM  of  the  graph  depicted  in  Figure 

1. 
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Because  /i  is  composed  of  ei,  and  e3,  the 
corresponding  elements  of  Ci  will  be  1,  and  the  remaining 
elements  all  will  be  0.  Three  nonzero  elements  exist  in  the 
first  row.  Similarly,  the  connections  of  /2  and  /3  are 

described  in  the  second  and  third  rows,  respectively. 

5 

Because  max  /  C  ,  =4  which  is  the  number  of  nodes  in 

i= 1...  J 

J=l 

the  network,  the  communication  network  satisfies  the  AM 
rule. 

If  only  e3  is  disconnected,  the  CLM  of  the  graph  is: 


e,  e,  e,  e,  e. 


2X 

3= 1 


(16) 


C2=h{  1  1  0  1  1)|(4) 

5 

Because  =  4,  the  network  still  satisfies  the  AM 


7=1 


rule. 


If  only  e5  is  disconnected,  the  CLM  of  the  graph  is: 

(17) 


e\  e2  e3  e4  e5 


3= 1 


C3=/1(l  1  1  0  0)1(3) 


Because  =3  <4,  the  network  no  longer  satisfies 

3= 1 

the  N-l  rule.  However,  it  is  easy  to  verify  that  the  overall 
network  topology  is  still  connected. 

If  the  communication  network  of  the  control  system  is 
designed  based  on  the  AM  rule,  malfunctions  of  any  one  of 
the  communication  channels  will  not  cause  the  control 
system  to  malfunction.  Thus,  the  distributed  optimization 
process  can  still  operate  properly,  as  will  be  demonstrated 
through  simulation  studies. 


Control  of  Turbine  Generator  Sets 


steady  state,  the  output  of  the  governor  system  is  zero 
because  the  algorithm  does  not  alter  the  total  generation 
during  optimization;  rather,  the  optimization  control 
system  adjusts  the  generation  among  generators  according 
to  the  current  output.  In  a  dynamic  state,  an  unbalance 
between  supply  and  demand  may  exist.  In  this  scenario, 
the  output  of  the  governor  system  is  nonzero,  and  the 
optimization  control  system,  accordingly,  will  optimize  the 
generation  according  to  the  current  power  demand  (current 
output  plus  governor  output).  Because  the  governor  system 
can  indicate  the  variation  in  the  power  demand,  the 
proposed  controller  is  deployed  behind  the  governor 
control  system  to  operate  according  to  the  updated  power 
demand. 

As  the  system’s  operating  condition  continues  to 
change,  it  becomes  more  helpful  if  the  algorithm  can 
respond  quickly.  Compared  to  centralized  solutions, 
distributed  solutions  have  simpler  communication 
networks  and  less  data  to  process.  Thus,  the  proposed 
distributed  solution  can  respond  more  quickly  to  changes 
in  operating  conditions.  If  properly  designed,  both  energy 
efficiency  and  dynamic  response  can  be  improved. 

SIMULATION  STUDIES 

An  SPS  shown  in  Fig.  4  is  simulated  to  test  the 
performance  of  the  proposed  solution.  The  SPS  has  4 
turbine  generators,  2  propulsion  motors,  4  zonal  load 
centers  and  1  radar  load. 


Once  the  active  power  reference  has  been  optimized  by 
the  proposed  algorithm,  the  turbine  can  be  controlled  to 
track  the  reference  in  order  to  control  the  electric  power 
output  of  the  generator  indirectly.  The  control  scheme  for 
the  turbine  generator  set  is  illustrated  in  Fig.  3. 


Fig.  3  Control  diagram  of  the  generator 

As  shown  in  Fig.  3,  the  input  of  the  optimization 
system  contains  two  parts,  the  current  output  of  the 
generator  and  the  output  of  the  governor  system.  In  a 


The  communication  network  for  the  proposed  control 
solution  is  designed  as  shown  in  Fig.  5.  It  consists  of  4 
nodes  (generators/agents)  with  6  communication  channels. 
It  is  easy  to  verify  that  the  proposed  communication 
network  satisfies  the  AM  rule.  Actually,  the 
communication  network  can  guarantee  that  the  system  will 
operate  properly  even  when  any  two  communication 
channels  are  lost.  This  communication  network  design 
helps  to  improve  the  reliability  and  survivability  of  an  SPS. 

Parameters  of  the  4  generators  for  generation  cost 
minimization  are  summarized  in  Tables  1  and  2.  During 
simulation,  each  generator  maintains  a  minimum  of  20% 
of  its  capacity  in  case  of  a  sudden  increase  in  the  power 
demand  if  the  SPS  experiences  an  emergency. 


e.\  e2  e3  e4  e5  e6 

IJ 1  0  0  1  0  f 

l2  1  10  0  10 

/3  0  1  1  0  0  1 

Cc  =  /4  0  0  1  1  1  0 

4010111 
4101011 
/7|_1  1  1  1  0  0 

Fig.  5  Communication  network  topology 


Table  1:  Parameters  of  the  cost  functions 


Turbine 
Power  (MW) 

Approximated  cost  functions 

a2 

«i 

a0 

50 

-0.0037133 

0.49252 

1.3795 

13.5 

-0.0076707 

0.37577 

0.18718 

20.1 

0.0069303 

0.58395 

-0.41063 

7.1 

-0.0039909 

0.30747 

0.07153 

Table  2:  Parameters  of  the  generators 


Num. 

Capacity 

Minimum 

Maximum 

1 

50 

10 

50 

2 

13.5 

2.5 

7.1 

3 

20 

4 

20 

4 

7.1 

1.5 

7.1 

Test  Case  1 

During  the  first  test,  a  sequence  of  scenarios  is 
simulated.  Originally,  the  speed  of  the  ship  was  20  knots; 
it  accelerated  to  21.4  knots  within  10  seconds  (from  15  5  to 
25  5).  After  that,  it  decelerated  to  16.2  knots  in  10  seconds 
(from  25  s  to  35  5).  The  power  demanded  by  the  ship’s 
speed  and  one  of  its  propeller  is  shown  in  Fig.  6  (in  this 
test  case,  the  two  propellers  are  assumed  to  be 
symmetrical). 


x  10® 


Fig.  6  Ship  speed  and  propeller  power 


The  total  load  and  generation  of  the  system  for  the 
duration  of  the  test  are  shown  in  Fig.  7. 


Fig.  7  Total  load  and  generation  of  the  system 


The  proposed  optimal  control  solution  is  deployed  at  5 
seconds.  The  generation  references  are  updated  every  0.1 
seconds,  which  is  more  than  enough  to  update  the 
reference  once  according  to  (10).  The  optimization  results 
are  shown  in  Fig.  8,  which  reveals  that  after  the 
optimization  system  is  turned  on,  the  fuel  consumption 
keeps  decreasing  until  it  reaches  the  minimum  at  about  15 
s.  After  that,  the  overall  fuel  consumption  increases  during 
acceleration  and  decreases  during  deceleration.  Compared 
with  the  case  in  which  no  optimization  occurs,  the 
proposed  solution  saves  approximately  25%  more  fuel. 


Fig.  8  Fuel  consumption  with  distributed  optimization 


The  active  power  outputs  of  the  four  generators  with  the 
proposed  solution  are  shown  in  Fig.  9. 


Fig.  9  Active  power  output  of  the  generators 

The  frequency  and  voltage  responses  are  shown  in  Figs. 
10  and  11,  respectively.  These  figures  reveal  that  the 
system  can  maintain  stability  and  that  the  voltage  and 
frequency  deviations  always  fall  into  the  allowable  ranges. 


Fig.  10  Frequency  response  with  the  proposed  solution 


Fig.  11  Voltage  response  with  the  proposed  solution 

Test  case  2 

In  this  test  case,  two  scenarios,  the  loss  of  one 
generator  and  losses  of  communication  channels,  are 
simulated. 

Loss  of  One  Generator 

During  simulation,  the  ship  cruises  at  a  constant  speed 
of  20  knots,  the  proposed  solution  is  deployed  at  5  s,  and 
generator  3  is  disconnected  from  the  SPS  at  20  s.  Some 
simulation  results  are  shown  in  Figs.  12  and  13. 


Fig.  12  Fuel  consumption  profile  under  generator  loss 


Fig.  13  Active  power  outputs  of  the  generators 

Fig.  12  also  shows  that  the  total  fuel  consumption 
actually  decreases  after  generator  3  goes  offline.  It  is  easy 
to  check  that  the  unit  power  fuel  consumption  of  generator 
3  is  relatively  high  in  the  range  of  operation  (see  Table  1). 
If  generator  3  is  online  and  forced  to  generate  a  minimum 
20%  of  its  capacity,  the  total  fuel  consumption  increases. 

Loss  of  Communication  Channels 

During  simulation,  the  ship  cruises  at  a  constant  speed 
of  20  knots,  the  proposed  solution  is  deployed  at  5  s,  and 
the  losses  of  communication  channels  occur  at  10  5.  Some 
simulation  results  are  shown  in  Fig.  14. 


Fig.  14.  Optimization  results  with  communication  channel 
losses 


Fig.  14  indicates  that  the  two  simulated  scenarios  of 
communication  channel  losses  did  not  degrade  the  control 
performance  significantly.  However,  fewer  communication 
channels  usually  translate  into  slower  optimization 
algorithm  convergence  speed.  Thus,  both  the  algorithm’s 
speed  and  cost  must  be  considered  during  communication 
network  design. 

CONCLUSION 

A  robust  distributed  control  solution  for  generation  cost 
reduction  is  proposed  for  SPSs.  The  distributed  sub¬ 
gradient  algorithm  can  be  implemented  with  an  MAS 
framework.  A  fully-distributed  communication  network 
that  is  robust  against  communication  channel  losses  can  be 
designed  based  on  the  N- 1  rule.  The  distributed  solution 
performs  similar  to  centralized  solutions.  The  proposed 
solution  is  stable,  efficient,  reliable  and  adaptive. 
Simulation  studies  show  that  the  proposed  solution  is  very 
promising. 
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